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Abstract: In this paper, a stochastic optimal control problem is investigated in which the system 
is governed by a stochastic functional differential equation. In the framework of functional Ito calculus, 
we build the dynamic programming principle and the related Path-dependent Hamilton- Jacobi-Bellman 
(HJB) equation. We prove that the value function is the viscosity solution of the Path-dependent HJB 
equation. 
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1 Introduction 

In many real world applications, the systems can only be modeled by stochastic systems whose evo- 
lutions depend on the past history of the states. So in this paper, we study a stochastic optimal control 
problem in which the system is described by the following stochastic functional differential equation: 

XT""(s) = 7t(0 + ^ 6(X7*'",M(r))dr + ^ w(r))dT4^(r). 

The cost functional is 



J{^uu{-))^E[j^ L(X2"",w(s))ds + *(Xj-")]. 

For the initial datum 74 G A, our optimal control problem is to find an admissible control u(-) e U[t, T\ 
so as to minimize the cost functional J. In this case, the value function ^ : A — R is defined to be 

F(7t)= , inf J{luu{-))- 

u{-)eU[t,T] 

It is well known that dynamic programming and related HJB equations is a powerful approach to 
solving optimal control problems (see [7], [Hj and [H]). Different from the HJB equations derived for 
stochastic delay systems (see jT], [S] and [T^), we establish the dynamic programming principle and 
derive the HJB equation in a new framework of functional Ito calculus. The functional Ito calculus and 
path-dependent PDEs is recently introduced by Dupire [S] (for a recent account of this theory we refer 
the reader to [5], [3] and [1]). Under the framework of functional Ito calculus, Peng and Wang [T3] 
obtained a nonlinear Feynman-Kac formula for classical solutions of path-dependent PDEs in terms of 
non-Markovian BSDEs. For the further development, the readers may refer to [12J and [6]. 
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In our paper, we obtain the following path-dependent HJB equation 

DtVijt) + inf Gi-/t,u,D,V,D,,V) = 0, 7(6 A, 
V{-fT) = «'(7t), 7t e A, 

where 

G(7t, P) ^ ^{Pa{jt,u)<j{jt,uf) + {p, 6(7t)) + L{jt, u), 
yi-/t,u,p,P) e A X [/ X E" X 5". 

We prove that the value function is the viscosity solution of the Path-dependent HJB equation. In 
addition, the stochastic verification theorem for the smooth case is also proved. 

The paper is organized as follows: in section 2, we present some fundamental results on functional Ito 
calculus and formulate our stochastic optimal control problem. We establish the dynamic programming 
principle in section 3. In section 4, we first derive the path-dependent HJB equation and prove the 
stochastic verification theorem for the smooth case. Then we prove that the value function is the viscosity 
solution of the path-dependent HJB equation. 

2 Problem formulation 

2.1 Functional Ito calculus 

We adopt the following notations in Dupire [5]. Let T > be fixed. For each t e [0, T], we denote by 
At the set of cadlag M'^-valued functions on [0,t]. 

For each 7 £ A^ the value of 7 at time s £ [0,T] is denoted by 7(5). Thus 7 = 7(s)o<s<t is a 
cadlag function on [0, T] and its value at time s is 7(3). The path of 7 up to time t is denoted by 74, i.e., 
7t — l{s)a<s<t G At. We denote A — lJte[o t] ^t- For each 7t G A and a; e R'^ we denote by 7f (s) the 
value of 7f at s £ [0,t] and 7t^ :— {^t{s)o<s<t,lt{t) + x) which is also an element in Af. 

We now introduce a distance on A. Let (•, •} and | • | denote the inner product and norm in R'^. For 
each < t,t < T and 7f , 7f G A, we denote 

llTtll sup |7t(s)|, 

sG[0,t] 

ht - JtW ■■= sup |7t(s At)- 7t(s At)\, 
se[a,tvt] 

doo{lt,lt) := supo<s<tvt l7t(s At) - Tt{s aT) \ + \t-i\. 

It is obvious that At is a Banach space with respect to || • ||. Since A is not a linear space, doo is not 
a norm. 

Definition 2.1. A functional u : A M> M is said to be A-continuous at 7t G A, if for any e > there 
exists 5 > such that for each 7t £ A with dad^t, It) < have |u(7t) — u(7t)| < e. 

u is said to be A-continuous if it is A-continuous at each 7t G A. 

Definition 2.2. Let v : K^M. and 7t G A &e given. If there exists p G , such that 

'I'ilt) = ^^(7t) + (P; a;} + o{\x\) as x -> 0, x G W^. 
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Then we say that v is (vertically) differentiable at 74 and define Dxv(^t) '■= P- v is said to be vertically 
differentiable in A if Dxv(^t) exists for each 74 G A. We can similarly define the Hessian matrix D^xvi^t) 
which is an S{d) -valued functional defined on A, where S{d) is the set of all d x d symmetric matrices. 

For each 74 G A, we denote 

7t,sW =7t(^Ai), r e [0,s]. 

It is clear that jt.s G As. 

Definition 2.3. For a given 74 G A, if we have 

vijt,s) = v{"ft) + a{s - t) + o(|s - t\) as s ^ t, s > t, 

then we say that v^jt) is (horizontally) differentiable in t at 74 and define Dtv{'jt) ■= a. u is said to be 
horizontally differentiable in A if Dtv(^t) exists for each 74 G A. 

Definition 2.4. Denote by 0'^{K) the set of functionals v (v{'jt))-yteA defined on A which are j times 
horizontally and k times vertically differentiable in A such that all these derivatives are A-continuous. 

The following Ito's formula was firstly obtained by Dupire [5J and then generalized by Cont and 
Fournie [2]. 

Theorem 2.1 (Functional Ito's formula). Let {il, J^, {T{t))t^^Q T], P) be a probability space. If X is a 
continuous semi-martingale and u is in C"'^'^(A), then for any t G [0, T), 

v{Xt)-viXo)^ f Dsv{X,)ds+ f Dxv{Xs)dX{s) 
Jo Jo 
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+ DxMXs)d{X)is) P-a.s. 

2.2 Stochastic optimal control problem 

Let be a d-dimensional standard Brownian motion defined on a complete filtered probability space 
{rt, J-, P; {J^{t)}t>o), where {J'{t)}t>o is the P-augmentation of the natural filtration generated by the 
Brownian motion W. 

Let T > be given. For any {t, 74) G [0, T] x A4, consider the following controlled stochastic functional 
differential equation: 

= 6(X2''",u(s))ds + r7(A:;^'^",w(s))dW^(s), sG[i,r], (2.1) 

with the initial condition X^*'^ — "ft, where u{-) — {u{s), s G [t,?"]} is a control process taking values in 
a compact set U of an Euclidean space and b : AxU ^ R" , a : Ax U — > R" x R'^ are given deterministic 
functions. 

The definition of strong solutions of (j2.1l) and the admissible controls are given as follows. 

Definition 2.5. Given the d-dimensional standard Brownian motion {W{s),s G [0,T]} and the control 
process {u{s),s G [t,T]}, a process {Ar^''"(s)}se[t,T] is said to be a strong solution of h2.1\) on the interval 
[t, T] and through the initial datum {t,jt) G l^yT] x A4 if it satisfies the following conditions: 

2. X'*'''"(s) is J- {s)- measurable for each s G 

3. The process {X^*'"(s),s G [i, T"]} is continuous and it satisfies the following stochastic integral 
equation P — a.s. 

X'^*'"(s) =74(0+ / 6(X7"",w(r))(ir+ / ai^X^"-^ ,u{r))dW{r). 
Jt Jt 



3 



Definition 2.6. For each t G [0,T], a five-tuples a = (fi, J-", P, VF(-), w(-)) is said to be an admissible 
control if it satisfies the following conditions: 

1. {Q,J-,P) is a complete probability space. 

2. W — {W{s), s G is a d-dimensional standard Brownian motion on {VL,T^P) over [t,T\ with 
W{t) = a.s. and J-{s,t) = (7{W{T),t < t < s} augmented by all the P-null sets in T . 

3. u : [i, T] X f2 — !■ [/ is an J-{s,t),s G [t,T]-adapted process on (Cl,J-,P). 

4. Under the control process u{-) — {u{s),s G [i,T]}, equation admits a unique strong solution 

{X"'*'^{s), s G [ijT]} defined on (fl^ P; {J-{s,t), s G [t,T]}) and through each initial datum 

It e At. 

5. The control process u{-) satisfies 



Eil^ \ L{X]*^^\u{s)) I ds+ I |] < 00, 



where L : A x U — > K. and 5* : A — > M represent the running and terminal cost functions, respectively. 

The collection of admissible controls a ~ {il, J^, P,W{-),u{-)) over the time interval [t,T] is denoted 
by U[t, T]. We will write u(-) G U[t, T] or a = (il, P, W{-), u{-)) interchangeably, whenever there is no 
danger of ambiguity. 

Given any initial datum 74 G A and any admissible control u(-) G U[t, T], we define the cost functional 
Jhuui-)) = E[ r L(X2"", u{s))ds + 



Then our optimal control problem can be stated as follows: 

For each jt G A, find a u{-) G U[t, T] so as to minimize the cost functional J. In this case, the value 
function F : A M is defined to be 

We assume b and a are uniformly continuous and they satisfy the following linear growth and Lispschitz 
conditions. 

Assumption 2.1. There exists a constant c > such that 

I b{xl,u) - b{x'f,u) I + I cr{xl,u) - a{x'f,u) \< c \\ x\ - xf ||, 
W{xl,u), {xl,u) G A X [/. 

Assumption 2.2. There exists a constant K > Q such that 

I u) I + I |< K{1+ II $t II), V(*t, u) G A X f/. 

Let L and 5* be two uniformly continuous real-valued functionals on A x t/ and A, respectively. 
Assumption 2.3. There exist a constant ci > and integer ki > such that 

|L(a>t,M)|<ci(l+||$, fi), I vE'(<I>t) |<ci(l+ II $T ll'^O (2.3) 
for all {^t, u) <E Ax U and $t e A. 
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Assumption 2.4. There exists a constant c > such that 

\L{^],u)-L{^lu)\<c\\ $1-$? II, 
^K)-*('i>l)l<c|| $^-$1 II, 

V($:^,w),($|,,m) e a X [/. 

Remark. Let Assumptions 2.1 and 2.2 hold. Then there exists a unique solution X for equation 
(1^ (see [8J). 

3 Dynamic programming principle 

In this section, we build dynamic programming principle for our optimal control problem. 
We first give some lemmas. 

Denote the set of ah continuous functions tp : [0, T] -> R" by C([0, T]; R"). 

Lemma 3.1. (Theorem 2.10 of II4I) Let {Q,T,P) be a complete probability space and (U,d) a Polish 
space. Let ^ : [0, T] x J7 ^> R" be a continuous process and J^f = cr(^(s) : < s < t). Then ip : [0, T] X — >■ 
U is {J^^}t>o-adapted if and only if there exists an rj € ■4J(C/) such that Vt G [0,T] 

ip(t,uj) = ri{t,^(- At,Lo)), P — a.s. u 
where A^{U) is the set of all {Bt+{C{[0,T];W^))}-progressively measurable processes. 

Lemma 3.2. Let 7f G A and {n,J^,P,W{-),u{-)) e U[t,T]. Then for any s £ [t,T] and F{r,t)t<r<a 
progressively measurable process 7, 

J(7,H;u(.)) = £;{/j£(X7=.",u(r))dr + vI/(X?-") |.F(s,0}H, P - a.s. u. (3.1) 

Proof. Since u{-) is {J^(r, t)}t<r<T-adapted, by Lemma [Ql there exists a functional £ A^^{U) such 
that Vr G [t, T] 

u(r, oj) = ?/'(r, A r, a;)), P — a.s. uj. 

For s G [t,T], let 7 be a J'{r,t)t<r<s progressively measurable process. We consider the following 
equation: 

dX'i^^'^ir) = 6(^7-'^, ?/'(r, W(- A r)))dr + aiX^^'"^ ,ip(r, W(- A r)))dW(r), 

(3.2) 

Xs =%, r G [s,T], 

Due to Assumption 2.1 and 2.2, there exists a unique solution of p.2p . 
Note that 

P{Q : U^) = %iuj) \ Tis,t)}{uj) 
= 1, P — a.s. Lu. 
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Then there exists an ilo G with P(ilo) = 1 such that for any fixed ujq £ Hq, 7^ becomes a deterministic 
function 7s(wo) under the new probabihty space (fl,T,P{- \ T{s,t){uj())). On the other hand, for any 

r > s, 

u{r,Lu) =ijj{r,W{- ^r)) ^ ip{r,W{- ^r,UJ) + W{s,uj)), 

where W{r) = W{r) — W{s) is a standard Brownian motion. Thus, u{r) is adapted to W{r) for r > s 
under the probabihty measure P{- \ T{s,t)){uJo). We obtain that 

{n,T,P{- I T{s,t)){u;o),W{-),u{-)) e U[t,T] 

under the new probabihty space {n,T,P{- \ J'{s,t)){ujo)). By the uniqueness of p.2p . we obtain our 
resuh. □ 

The value function (|2.2p has the fohowing properties. 

Lemma 3.3. The value funetion V is continuous and there exists a constant C2 > and a positive integer 
k2 such that, for every 74 g A, 

|^(7t) l<C2(l+||7t 11)"^ 
In addition, Ve > 0, there exists a constant 5 > such that \ V{4)t) ~V{lPs) |< £ whenever \\ (pt —ifis ||< 

Proof. Due to Assumption 2.3, it is easy to prove that V has at most polynomial growth. We only 
give a brief proof of the continuity property. 

Fix m(-) G U[0,T] and the initial datum (f)t and (ps, respectively. For 0<t<s<T,we have 

J{^t;u{-))-J{cp,;u{-)) 

= £;[//i(X,^'^",M(r))dr + /J[L(X,*'>^u(r)) -L(X,^-",M(r))]dr + 

By Assumption 2.3 and 2.4, there exists a constant c > such that 

I J(0t; - J{^s;u{-)) \< c{\s~t I (1 + E[\\ Xp'- II]) + E[\\ Xp^^ - X^-'^ ||]). 

Then, by Assumptions 2.1 and 2.2, we can obtain the basic estimations of solution of (|2.ip which leads 
to the following result: 

There exists a constant (5 > such that 

J{(t)t\u{-)) - J{lps\u{-)) |< e, 

whenever \\ (j)t — Lps \\< 5. 
Thus, it yields that 

I V{cj,t)~V{^s) \<e. 

This completes the proof. □ 

The following dynamic programming principle holds. 

Theorem 3.1. Let Assumption 2.1 — 2.4 hold. Then for any 7f G A and any s G [t,T], 

V{^t)^ inf i?[//i(X7-",u(r))dr + V-(X2-")]. (3.3) 
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Proof. Denote the right side of (|3.3p by 1^(7*). For any e > 0, there exists an u(-) e U[t, T] such that 

V{jt) + e> J{^uu{-)) 
= E{J^ L(X7"", u{r))dr + 

= L(X7"", «(r))dr + £;[/J w(r))dr + vIr(X?-") | .F(s, t)]} 

= £;{/;i(X7-^^.(r))dr + £;[/JL(x5''"'^u(r))dr + vI.(X^='''"'") [ 
= E{j; L{X;!^^-,u{r))dr + JiX]^'^} 
> E{j; L{X;!^^^,u{r))dr + V{X]*'^)} > V{^t). 
Conversely, by Lemma for any £ > 0, there exists a 6 — S{e) such that whenever || 74 — 74 ||< 6, 

J{jt;u{-)) - J{it;u{-)) I + I V{jt)-V{it) \<e, yu{-) eU[t,T]. 

Let {Dj}j>i be a Borel partition of C([0, s];R") with diameter diam(Z?j) < 6. Choose £ Dj. For each 
j, there is {nj,J^j,Pj,Wj{-),Uj{-)) G W[s,r] such that 

Jixi;u,{-))<V{xi)+e. 

Hence for any Xg G Dj, we can get 

J{xs;uj{-)) < J{xl;uj{-))+e < V{xi)+2e < V{xs) + 3e. (3-4) 
By the definition of the admissible control, there is a functional V'j G ^^([/) such that 

Uj{r,uj) — ^pj{r,Wj{- A r,uj)), Pj ~ a.s. w G ilj, r G [s,T]. 

Now for any (f2, J^, P, W^(-), u{-)) G T], let X{-) — denote the corresponding state trajectory. 

Define a new control 

u{r,uj) ^ u{r,uj), if re[t,s), 
Clearly, u{-) G l([t,T]. Thus, 

n7t) <J{it;u{-)) 

= E{J^ L{X?-\u{r))dr + ^iX^^-'^)} 

= w(r))dr + L(X7'■^ «(r))dr + vI/(X^-«) I ^(s, t)]} 

= i^{//L(X7-^w(r))dr + i^[/JL(x5'■''^u(r))dr + vI/(X^="'''") | 

= L(X7--,w(r))a!r + J{X]*^^)} 

< L(X7''",M(r))dr + V{X2'''') + 3e}, 

where the last inequality is due to p.4p . Taking the infimum over u{-) G U[t,T], we obtain the result. 
□ 
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4 Path-dependent HJB equation 

4.1 Classical solution 

In this subsection, we suppose that the value function V is smooth, i.e., V € C"'^'^(A). 

Theorem 4.1. Let Assumption 2.1 — 2.4 hold and the value function V G C^'^(A). Then V is a solution 
of the following path- dependent second-order partial differential equation: 

DtV{jt) + inf G(7t, u, D^V, D^^V) - 0, 7* € A, 
Vi^jr) = *(7t), 7t e A, 

where 

G{lt,u,p,P) = itr[Pcr(7(,u)CT(7t,u)^] + {p,b{-yt,u)) L{'jt,u), 

V(7t, u,p, P) £ A X U X M" X 5" f5" is the set of all n order symmetric matrix). 

Proof. Fix 7t e A and u E U. Let X'^*''^{-) be the state trajectory corresponding to the initial datum 
7t and the control u(r) = u. By Theorem 13.11 and Functional Ito's formula, we obtain 

Let s 4, i, we have 

< DtVicit) + G(7t, M, D,y{-it),D,,y(cit)). 

This result in 

< DtVijt) + inf G(7t,w,D,y(7t),i?..y(7t))- (4-2) 

On the other hand, for any e>0, 0<t<s<T with s—t > small enough, there exists a u^^s{-) G U[t, T] 
such that 

V(7t) + e(s -t)>E[ r L{X:!^-^'-,u,Ar))dt + V{X2*'^^-)]. 



By Functional Ito's formula, 

= ^i?[//{A^(7t)+G(X7''"-%u,,,(r),i?,T/(X7""-=),i?..T/(X7''"-=))}dt] 
> ^i?[//{AV^(7t)+ mf^G(X7''"-%«,i?,V^(X7-"-=),^,,F(X7''"-0)}dt], 

Let s 4, <, we have 

e > DtVi^t) + inf G(7t,7x,D,y(7t),D,,F(70). (4-3) 
Combining (j4.2p and (|4.3p . we obtain our conclusion. □ 
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4.1.1 Classical stochastic verification theorem 

Now we give the classical stochatic verification theorem. 

Theorem 4.2. Let Assumption 2.1 — 2.4 hold. V G C^^^(A) is a solution of the HJB equation 
Then 

V{^t)<J{lt;u{-)),yu{-)eU[t,T], 7teA. (4.4) 
Futhermore, an admissible pair {X{-),u{-)) is optimal if and only if 



DtV{Xs) ^ - \x,iG{Xs,u,D,V{Xs),D.,,V{Xs)) 
= -G{XsMs),D.,V{Xs),D,,V{Xs)), 

a.e. s G [t, 7"], P ~ ci-S. 

Proof. Applying functional Ito's formula to V{X]*''^), we obtain 

V{jt) - E[^{X}'''')] - E[J^{DtV{X?^'^) + {D,V{X?^'-),b{X?^'\u{r))) 

+ y,r{D,^ViX?^''')a{X?^''',u{r))a{X?^'^,u{r)f)}dt] 
= Jht;u{-)) - E[J^ L{X?^^\u{r))dt] - E[j;'{DtV{X?^n 

+ u{r))) + i<r(i?,,l/(X7'>")<^(^7*'", u{r))a{X?^''',u{r)y)}dt] 

< J(7t;M(0) +inf„eaG(X7*>^u,i^,F(X;'■-),i?,,y(X7*'"))}d^^ 

Then follows. 

Next, applying (|4.6p to (X(-), we have 

V{lt) = J(7t; "(•)) -E[J [DtV{Xs) + GiX,,uis),D^ViX,), D,,ViX,))]ds]. 
If dl^l) holds, then 

Vijt) = Jiluui-)) 

and {X{-),u{-)) is optimal. 

Conversely, if {X{-),u{-)) is optimal, then 



(4.5) 



(4.6) 



Applying Ito's formula to V{Xs), we have 

V{lt) = Jht;u{-)) - E[j^ [DtV{X,) + G{X,,u{s),D^V{X,), D^^V{Xs))]ds\ 

Note that 

DtV{Xs) + G(X, m(s), D,V{X,),D,^V{X,)) < 0. 

We have immediately 

DtV{X,) + G{Xs,u{s),D,ViXs), D,,V{Xs)) - 0. 
Thus, we get the desired result. □ 



4.2 Viscosity solution 

In this section, under Assumption 2.1 — 2.4, we show that the value function V is actually a viscosity 
solution of the path-dependent HJB equation (j4.1l) . We first give the definition of the viscosity solution 
of (|i7T|) as follows. 

Definition 4.1. Let w £ C(A), we say that w is a viscosity subsolution of i4.1\ ), if\/S > 0, VF G C^'^(A), 
7t G A satisfying T > w on Uo<r<(5^*+'' '^'^'^ ^ilt) — w{'^t), we have 

Ar(7t) + inf Gijt,u,D,T,D,,T) > 0. 

where 

G{jt,u,p,P) = itr[Pcr(7t,M)(T(7f,u)^] + {p,b{-ft,u)) + L{jt,u), 
V{-ft,u,p, F) e A X t/ X M" X 5". 

We say that w is a viscosity supersolution of J.^. i/V(5 > 0, VF £ C^'^(A), 74 G A satisfying V < w on 
Uo<r<5^t+'- r(7f) = w(7t), we /laue 

Ar(7t) + inf G{-fuu,D,T,D,j:) < 0. 

We say that w is a viscosity solution of J^. J| j i/ it is both a viscosity supersolution and a viscosity 
subsolution of 

Then we have the following main result: 

Theorem 4.3. Let Assumption 2.1 — 2.4 hold. Then the value function V is a viscosity solution of the 
path- dependent equation fi4.1\ ). 

Proof. (1) For any 5 > and F e C^''^{A), let F > F on [jo<r<s ^t+r and F(7t) = V{jt)- Fix a 
u E U. Let A'''''"(-) be the solution of (12.11) with the control u{s) = u. Then by Functional Ito's formula, 
for t < s < t + 6, we have 

i?[F(A2--)]-F(7,)] ^ ^ 

(4.7) 

= E[j;{DtT{X?^^) + G{^t,u, D^T{X?-^), D^^T{X;!^-")) - L{X?^-", u))dr]. 
On the other hand, for any s E [t,t + S], by the dynamic programming principle, we have 

V{^t) < E[j^ L{X^/^^,u)dr + V{X2^'^)]. 

Notice that T >V and F(7t) = l/(7t). By g^]), we get 

< E[j' M)dr + V{X]^'^)] - y(7t) 

< w)dr + F(X2-«)] - F(70 

< AF(A7'^«) + G(7t,u,i^J(A7'^«),i^,,F(A7'-))dr], 
Dividing both sides by {s — t), we have 

< Ar(X7*-) + G(7t, u, 7^,F(X7*-), 7^,,F(A7'^"))dr]. 
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Now let s -It. This leads to 

Ar(7t) + inf„6[/G(7t,u,-D,r(7t),^..r(7t)) > 0. 

(2) Next, we want to prove ^ is a viscosity supersolution. 

For any 5 > and T e C^^^^^)^ let T < F on Uo<r<5^t+r and r{jt) = V{-ft). For any e > 
and S > s > t (with s ~ t > small enough), by dynamic programming principle, we can find a 
u(-) = Ue,s(-) e l^[t,T] such that 

>E[v{jt)-r{^t)-v{X2'-^^) + r{xr--)] 

(4.8) 

> -e{s ^t)+ E[j; L{X:!^--,u{r))dr + r(X2-«) - r{jt)]. 
Then applying Functional Ito's formula to r(X2''"), we have 

(4.9) 

= E[J^'{DtT{X?*^^) + G{jt,u,D,r{X?*'^),D,,r{X?^'^)) - L{X?*'^ ,u))dr]. 
Dividing both sides of (|4.8p by (s — t), we get 

e> ^E[j; L{X?^'\u{r))dr 

+ //(Ar(X7*>-) + G(7t,u,z?,r(X7*^«),z?,,r(X7"")) - L{x;'*'^,u))dr] 

> I^^[//(Ar(X7"") + inf„ec/ G(7t, u, D,T{X;!^'^), D,,r{X?*'^))dr]. 
Let sit. It yields 

DtT{-ft) + MueuG{-ft,u,D,r{jt),D,,r{jt)) < 0. 
Thus, V^(7t) is a viscosity supersolution. This completes the proof. □ 

Acknowledgements The authors would like to thank Prof. Shige Peng for some useful conversations. 
References 

[1] M. H, Chang, T. Pang and M. Pemy, Optimal control of stochastic functional differential equation 
with a bounded memory. Stochastic, 80, 69-96, 2008. 

[2] R. Cont and D. A. Fourni, Functional Ito calculus and stochastic integral representation of martin- 
gales, in arxiv.org/abs/1002.2446, 2010. 

[3] R. Cont and D. A. Fourni, A functional extension of the Ito formula, C. R. Math. Acad. Sci. Paris 
348 (2010), no. 1-2, 57-61. 

[4] R. Cont and D. A. Fourni. Change of variable formulas for non-anticipative functionals on path 
space, J. Fund. Anal. 259 (2010), no. 4, 1043-1072. 

[5] B. Dupire, Functional Ito calculus, Portfolio Research Paper, Bloomberg, 2009. 

[6] I. Ekren, C. Keller, N. Touzi and J. Zhang, On Viscosity Solutions of Path Dependent PDEs, to 
appear in Annals of Probability (larXiv:1109.5971 ). 2011. 



11 



[7] W. H, Fleming, H. Mete Soner, Control Markov processes and Viscosity Solutions (New 
York:Springer Verlag) 

[8] R. S. Lipster and A. N. Shiryaev, Statistics of Random Processes I, Springer, 1978. 

[9] S-E. A, Mohammed, Stochastic Functional Differential Equations, Research Notes in Mathematics 
No.99 (Boston, London, Melbourne: Pitman Pubhshing), 1984. 

[10] S-E. A, Mohammed, Stochastic Differential Equations with memory-theory, examples and ap- 
plications, Stochastic Analysis and Related Topics 6. The Geido Workshop,Progress in probabil- 
ity,Birkhauser, 1996. 

[11] S. Peng, A generalized dynamic programming principle and Hamilton-Jacobi-Bellmen equation, 
Stochastics and Stochastics Rep., 38 (1992), pp. 119-134. 

[12] S. Peng, Note on Viscosity Solution of Path-Dependent PDE and G-Martingales, in 
arxiv.org/abs/1106.1144vl. 

[13] S. Peng, Falei Wang, BSDE, Path-dependent PDE and Nonlinear Feynman-Kac Formula, in 
arxiv.org/abs/1108.4317. 

[14] J. Yong, X. Y. Zhou. Stochastic controls: Hamiltonian systems and HJB equations. 1999. 



12 



